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1.  INTRODUCTION 


Consider  the  model 

x(t)  =  f(t)  +  et,  0  <  t  <  1  (1.1) 

where  f(t)  is  a  nonrandom  function  with  the  form: 

f  u  +  B -j ( t  -  tQ),  0  <  t  <  tQ 
f(t)  °  (1.2) 

(_m  +  e2(t - t0),  t0  <  t  <  i. 

tg  is  called  the  slope  change  point  (of  the  function  f(t)).  (et,  0<t£l 
is  an  independent  random  process  with  zero  mean  function. 

In  order  to  estimate  and  make  inference  on  tQ,  observe  x(t)  in 
equal  space,  that  is,  we  observe  x(^),  1  =  1,2, ...,n.  for  simplicity, 
we  write  and  e^  for  x(^)  and  e(^),  respectively,  but  we  must  keep  in 
mind  that  x.  and  e^  are  dependent  on  i  and  n,  and  e-j,  . . . ,  en  are  indepen¬ 
dent.  Generally,  u,  0^  and  B-|  are  unknown.  There  are  many  ways  to  esti¬ 
mate  the  location  of  tg.  For  example,  see  Hudson  (1966),  Hinkley  (1970)  and 
Krishnaiah  and  Miao  (1986a,  1906b),  but  it  is  more  important  to  make  an  in¬ 
terval  estimate  of  tQ.  This  problem  is  associated  with  the  distribution  of 
the  estimator  to  tg.  Feder  (1975)  proved  that  the  LSE  (Least  Square  Esti¬ 
mator)  of  tg  is  asymptoticly  normal.  Hinkley  (1971)  proposed  an  approximate 
distribution  of  the  MLE  (Maximum  Likelihood  Estimator)  of  tQ,  but  it  is  too 
complex.  If  tg  is  the  jump-point,  Csorgo  and  Horvath  (1986)  proposed  some 
asymptotic  distributions  for  some  nonparamatric  estimators  of  tg. 

Recently,  Chen  (1987)  developed  such  an  estimator  of  tg  where  distri¬ 
bution  is  the  first  type  of  extrimal  distribution.  This  estimator  of  tg 
is  proposed  first  by  Yin  (1986)  to  estimate  the  location  of  one  or  more 
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change  points.  Going  along  with  this  heuristic  method,  we  give  an  esti¬ 
mator  of  tQ  for  models  (1.1)  and  (1.2).  Its  distribution  can  then  be 
calculated  conveniently. 

In  Section  2  we  treat  the  case  that  e^ ,  •••»en  are  normal  with  zero 

2 

mean  and  positive  variance  o  .  In  Section  3  we  treat  the  case  that 
e.| ,  ...»en  are  normal  with  zero  mean,  but  their  common  variance  is  un¬ 
known.  When  random  errors  e^eg.  ...  are  not  normal,  for  example,  e^  has 
moment  generating  function,  or  only  has  finite  (2  +  6 )-th  moment,  the  con¬ 
clusion  established  in  Section  1  is  also  true.  This  is  discussed  in 
Section  4.  Finally,  In  Section  5  we  discuss  the  estimation  of  the  slope 
change  under  some  mild  conditions.  This  estimation  is  asymptotic¬ 

ally  normal. 

i 

i 


2.  ERROR  IS  NORMAL  WITH  A  KNOWN  VARIANCE 


In  this  section  we  suppose  that  C e( t) >  is  a  white  noise  process 

2 

with  mean  zero  and  known  variance  a  .  At  first  we  prove  a  theorem  on 
which  our  method  is  based. 


THEOREM  1 .  Suppose  that 

xk  =  a  +  n 0  +  ek*  k  =  1 . n*  ^ 

2 

where  e^,  ...,en  are  i.i.d.,  e-j  -  N(0,o  ).  Let  m  =  mn  be  a  positive 
integer  such  that 

n  »  m  »  n^log^n.  ( 


Hereafter,  u„  »  v  >  0  means  lim  ~  =  «.  $et 
T  n  n  n->«  vn 


Y  *  JL 

k  2/m 


xk-3m^  "  (xk-3m+l  +  *" +xk-2rJ 


Rxk-4m+l  +  '  *  *  + 

■  ^xk-2m+1  +  *'*  +  xk-m^  +  *xk-m+l  +  "•  +  xk*l 


k  =  4m,  4m+l ,  ,  n. 


Write 


£ 


n 


max  |  Y  | , 
4m<k<n 


and 


A 

n 


-1/2 


(x  +  2  log(|i-5)  +ilog  log(|^- S)  -  ^-log  ir)  ,  ( 


i  (A  n/v l nt\' 


lim  PI—  <  An(x)  =  exp{-2e  },  -«  <  x  <  «. 

n-x»  \°  / 


(2.5) 


Proof.  Construct  a  standard  Brownian  Motion  { W( t ) :  t  >  0),  such  that 


■  ,£(v- 


+  xk  - ka  - 


k(k-H) 


3^  /o,  k  =  4m,... ,n.  (2.6) 


Based  on  this  W(t),  we  further  construct  the  Gaussian  process  Z(t)  such 


Z(t)  =  -i- 


=  —  W(t  +  5)  -  2W(t+^p)  +  2W(t+|)  -  W(t)  ,  t  i  0. 
/5  _  _ 


It  is  easy  to  see  that 


Yk  =  oZ ^  ’  5),  k  =  4m*...*n, 


and  the  covariance  function  p(t)  of  Z(t)  is 


1  -  |T 


p(t)  *  \  r  |t  !  -  2 


1  -  ± 


lTl  1  4 


5  |  |  5 

T-  lTl  -  2 

X  i  M  i 5 


I T  I  >  5 


ln  »  sup{  | Z(t)  | :  o  <  t  <|£-  5), 


nn  =  *n  -  °V 


-.Ivlvv  .V  -V  A 


(2.7) 


(2.8) 


(2.9) 


It  can  be  proved,  similar  to  Chen's  method,  that 


lim  n/log  n  =  0,  a.s.  (2.10) 

n-H*>  n 

For  the  Gaussian  process  Z(t)  with  covariance  p(t),  the  conditions  of 
a  theorem  of  Qualls  and  Watanable  (1972)  are  satisfied,  we  get 

lim  p(L  <  A  (x))  =  exp{-2e~x}.  (2.11) 

But  An ( x )  is  a  linear  function  of  x,  hence  for  n  large, 

p(in  5.An(x  -  | ax |))-  P(nni  |  ax | /✓S' log  n)  <  P(cn/o  <  An(x)) 

<  p(in  ^  An(x  f  I  Ax  I ))  +  P(nn  1  |  AX  I  /2  log  n).  (2.12) 

From  (2.10)  to  (2.12),  letting  n  +  »,  then  Ax  0,  we  get  this  theorem. 

This  theorem  represents  an  asymptotic  distribution  of  statistic  £  . 

n 

It  suggests  a  way  to  test  the  null  hypothesis: 

Hq:  e  =  0,  (2.13) 

i.e.,  there  is  no  slope  change  point  in  model  (1.1)  and  (1.2),  as  follows. 
For  the  chosen  level  a,  0  <  a  <  1,  solving  the  equation  exp(-2e  )  =  1  -  a, 
we  get  x(a)  =  -log(-  ^-log(l  -  a))  .  Set 

d  -  Cn(«,d)  -  An(x(a))  .  (2.1+) 

The  null  hypothesis  (2.13)  is  rejected  when  and  only  when 

Sn  >  oCn(a,d).  (2.15) 

Under  the  hypothesis  (2.13),  this  test  has  an  asymptotic  level  a  as 
sample  size  n  tends  to  infinity. 


-v"  y  jl1" 


* 


m 

k 


we  also  give  an  estimate  of  the  power  en  =  B2*o)  this 


test.  Let  r  be  the  integer  such  that 


r<  t  <*±1 

n  —  n 


r+2m 


"2rT  'p2 


-&1 ) .  o2^  . 


Hence* 


^n^l*^2*0^  —  ^0V+2n^  >  0^n(a»d)) 


/_3/ 2 

”  ‘(-?Hrl62-sll  ‘  cn<“'d)) 


(2.16) 


where 


>(x)  =  f  —  e"t2^2dt. 

J  /2iT 


From  this  inequality,  in  order  to  get  a  larger  en,  m  must  be  given  a 


larger  value.  Note  that  the  order  of  Cn(a,d)  is  (log  ^)^2  for  fixed  a,  so  our 

test  has  a  larger  power  when  and  only  when  m  »  n2>/3log2/,3n.  It  is  very  differpi 
from  the  case  that  f(t)  is  a  step  function.  In  our  case,  the  power  is 


lower.  The  reason  is  evident  because  there  exist  more  estimated  parameters. 


Now  consider  the  interval  estimation  of  a  slope  change  point.  The 


existence  of  tg  may  be  a  fact  known  in  advance,  but  usually  it  is  evidenced 
by  the  rejection  of  the  null  hypothesis.  If  tg  is  evidenced  to  exist,  we 


adopt  the  following  rule. 


*  ■* 

RULE.  Find  an  integer  k  such  that  |Y.  |  =  c  .  Take  ,  —  as  the 

k  n  n  n 


confidence  interval  of  tg. 


The  length  of  this  interval  is  Hence,  the  smaller  the  value  of 


•'  -  -  *.* 
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m,  the  more  accurate  is  the  estimate.  But,  as  described  by  Chen,  m  cannot 
be  taken  too  small  so  as  to  get  a  high  confidence  coefficient  and  decrease 
the  risk  of  false  acceptance  of  the  hypothesis  (2.13)  if  the  existence  of 
tg  is  to  be  decided  by  the  test  above.  Here  we  give  an  estimate  of  the 
confidence  coefficient  y  of  this  interval  as  follows. 


_  n/k-4m  .  k\ 


M[r%m]|Ykl  —  aCn{ct,d)|n|  1  Yr+2rJ  >  aCn(a’d) 


A  =  |  sup  I y.  I  <  aC  (a,d)j  , 
)4m<k<r  K  n  ] 

&  =  )  sup  | Y.  |  _<  aC  (a,d)l  , 
|  r+4m<k<n  ] 


sup  1 Y.  I  <_  oC  (a,d)(  , 
r+6m<k<n  K  n  \ 


c  '  {lyr+2ml  »  °Cn<“'d)]  • 


Notice  that  is  independent  of  both  A  and  C,  and  Bc=b^,  we  have 
y  >  p((A  U B) c)  =  P(AC)  +  P(ABC)  =  P(C)  +  P(B)  -  P(ACU  B) 

>  P(C)  +  P(B)  -  P(ftCU  B] ) 

>  P(C)  +  P(B)  -  P(ffC)  -  P(B1)  +  P( AB] C) 

=  P(C)  +  P(B)  -  P(AC)  -  P(B1 )  +  P(AC)P(B1 ) 

1  P(C)-(P(B1)  -  P ( B ))  -  P(A)P(B1 ) , 

where  D  denotes  the  complementary  event  of  D.  Again,  using  Theorem  1, 
we  get 


X1  =  xl<“>  =  Cn(“-d)(?,09(lff'5)) 


-  (2  log(f£-  5)  +  jlog  log(|^-S)  -  \  log  „),  (2.18) 

1  /2 

x2  '  x2(o)  =  C„(«,d)(2  logl^1'  -  5)) 

-  (2  1og(^i)-5)  +  jloglog^^-S)  -  \  log  (2.19) 

1/2 

x3  =  x3(o)  =  Cn(a,d)(2  1og(^ri-7.5)) 

-  (2  1og(%^-  -7.5)  +  jloglog(%^-7.5)  -  |log»).  (2.20) 


As  a  rough  approximation,  if  we  have  no  information  about  tQ,  apply¬ 
ing  this  fact  that 


Pf  sup 
K^rr,r+4m] 


| Y.  J  <  oC  (a,d))  >  P(  sup  | Y.  |  <  oC  (a,d)) 
K  n  /  -  \4m<k<n  k  n  / 


By  those  Inequalities  above,  we  see  that  y  Is  larger  as  - — ~ 

ke2 

is  larger.  Note  that  — -  is  the  absolute  of  difference  between 

n  n 

f(jj-  +tg)  -  f ( t q )  and  f(tg)  -.f(tQ-£).  Now  the  length  of  confidence 
4m 

interval  is  — ,  the  slope  change  point  tg  is  of  practical  means  only 

when  ]  I  1s  larger  than  o.  Generally,  we  can  assume  that 

^le2-ell  -  w^ere  M  1S  decided  by  practical  consideration. 

Using  (2.17)  or  (2.22),  we  may  give  the  following  important  question 
an  estimation  on  the  integers  m  and  n:  form  a  confidence  interval  of  tg 
with  prescribed  length  dg  and  confidence  coefficient  1  -  ag.  To  do  this, 
if  there  is  no  information  on  tg,  we  solve  this  equation  by  replacing 
a  and  d  in  (2.22)  by  ag/2  and  dg, 


*(2^"“  Cn^°c/2,d(p)  "a(/2  = 


1  _  an» 


and  get 


m  :  4M 


(CnS/2,  d0J  +  V/2)2, 


(2.23) 


_  -  4m 

n~  V 


(2.24) 


m|82-B1| 


where  M  =  — — - ,  u  is  the  number  such  that  1  -  *(u  /0) 

00  Og/2  Og/2 

For  example,  let  M  =  3,  dg  =  0.1  and  aQ  =  0.05.  Then 

m  =  18,  n  =  714. 


V2- 


If  we  further  know  that  an  <  tg  <  bn,  here  a  and  b  are  constants  known 
a  priori,  then  by  (2.17)  we  could  solve  the  equation: 


11 


'ff-c„(a.d0))-  ( 

-  ^1  -  exp{-2e 


-x,(a) 
exp{-2e  J 


-x 

}  -  exp{-2e 
-x.(a) 

exp{-2e 


“O' 


For  example,  let  M  =  3,  dQ  =  0.1 ,  a  =  aQ  =  0.05  and  a  =  0.2, 
Then,  • 


(2.25) 
b  =  0.8. 


Cn(0.05,  0.1)  =  4.1217 


m  *  15,  n  ■  597. 

Based  on  the  results  above,  we  see  that  if  more  information 
about  tQ  is  known,  then  not  only  does  it  increase  the  confidence  co¬ 
efficient  of  y,  but  also  decrease  the  threshold  value  of  rejecting 
the  null  hypothesis  (2.13). 


Table:  The  values  of  (m,n)  when  r  <_  tQ  <  i  -  r, 
M  =  3,  ag  s  0.05  and  dg  =  0.1. 


°  \  (rn,n) 

0 

0.1 

0.15 

0.2 

| 

20.69.  828 

14.93,  597 

14.92,  597 

0.025 

17.85,  714 

17.70,  708 

16.18,  647 

16.17,  647 

3.  ERROR  IS  NORMAL  WITH  UNKNOWN  VARIANCE 

2 

When  o  is  unknown,  we  can  use  its  estimate,  say  ac .  Then  substitut- 

n 

a 

mg  for  a  in  (2.15)  to  perform  the  test,  Chen  proved  the  following 
theorem. 

THEOREM  2.  Under  the  conditions  of  Theorem  1  ,*  if  6^  is  an  estimator 


of  o  satisfying 


limjc^  -  o ^ 1 1 og  n  =  0, 
n-*»  n 


(3.1) 


'=  "  means  convergence  in  probability.  Then 


^  P(y5n  -  Vx>)  ■  exp{-2e-x). 


Our  problem  is  to  find  such  an  estimator  sati tying  (3.1).  The  LSE  of 

2 

a  suggests  the  form  (3.5)  given  below.  We  prove  this  estimator  satisfies 

(3.1). 

Suppose  (x.j . xn)  is  observed  from  the  model  (1.1)  and  (1.2). 


V«|  +  ”  0-j  »  i  =  1  •••• 


v»2  ^  p  @2  ^  Gi »  ^  ~  ni+l,...,n. 


(3.2) 


n.  n.+l 

where  we  assume  that  the  slop  change  point  tQ  falls  into  ,  n  ■) .  By 

(1.2) ,  we  have 


1^1  -n2l  -  n  l62"  Bll* 


(3.3) 


1  ^ 

s  £  I  xi * 
c  i=l  1 


x2m"  n-c  j=^+1  X1  * 


ELc  =  tlFT7fL(c-f)xi*  eRc 


l  (i-c)x. 
i=c+l  1 


Then  the  following  result  holds: 

2 

THEOREM  3.  If  ,  ....  en  are  l.i.d.,  and  e]  -  N(0,o  ),  set 

Snc  ‘  j,<x1  -x1c)2  +  , jtl(x1  -x2c)2  ' 

3(n-c) (n-c+1 ) /  -  x2 

fPc-1  uRc"  2c;  * 


(3.4) 


°nc  =  n  Snc*  c  =  m+1 . n_m* 


(3.5) 


a2  2  P 

I  m^n  “Cl  |log  n  - *  0. 


m<c<n-m 


(3.6) 


Proof ,  It  is  easy  to  see  that  the  expressions  of  (3.4)  and  (3.5)  are 
the  form  of  LSE  of  model  (3.2)  under  the  assumption  that  c  is  the  slope 
change  point.  Write 


e  - -f 
c  n  c 


Fc  = 

0 

0 

e  „ 

—  q„  „  j 

\ 

n-c 

n  3n-c  / 

ej  =  (1»*”* 

])lxj» 

=  (j-1 

,  j 

~2 »  •  • . » 

1 

9j  =  (1»,*,» 

1 

j)lxj’ 

6 

=  (w-j » 

*1 

’  y2,  e2^ 

X  =  ( x  i  f  •  •  • 

•xn>' 

and 

e 

=  ( G  -j  * 

•  •  « 

,en)'. 

(3.7) 


(3.8) 


X  .  F  «  +  c 


(3.9) 


4  *  *'(I-Fc(|:cFc)''Fc)x' 


Our  line  to  prove  this  theorem  is  as  follows:  When  ^  f  $2,  let  h  be 

o  2 

the  integer  such  that  a ,  =  min  8  . 

nh  l<c<n  nc 

1.  If  | h  -  m |  >_  n/log  n,  then  Sjr  -  S|L  >  0  In  probability. 

nc  nn^ 

2.  If  | h  -  m |  £  n/log2n,  then  |o2c  -  a2n  (log  n  -4  0. 

3*  l°nn1  "  °2I1o9  n  °* 

When  e1  =  e2>  we  have  for  any  c,  |o2c-o2|log  n  0.  It  can  be  calcu¬ 
lated  that 


fe 

ni=i 

1  C-l  1  c-l  n 

-4  4V 


FcFc  = 


(n-c) 


,  n-c 
1 1  ti 
ni-i 


t  n-c  ,  n-c  . 

I  l  1  X  l  i' 

n1=l  n2  i=1 


(3.10) 


'  c  c' 


2(2n-2c+l 


Ln-c)(n-c-l 


n-cMn- 


12n 

;n-c)(n-c+l )(n- 


a2cn 


a4cn 


-b2cn 


"b2cn  b4cn 


(3.11 


Fc(FcFc)‘lFc  =l  b4i 

v*  blcen-cen-c  "  b2c^n-cen-c  ”  b2cen-c^n-c +  n  ^n-c^n-c 


a,  e  e*  -  a„  f  e*  -  a«  e  f *  +  -—  f  f 1 . 
lc  c  c  2c  c  c  2c  c  c  n  c  c* 


(3.12 


Not  loss  of  generality,  we  assume  that  n  >  c  >  n-j.  Set  k  ®  c  -  n^. 


Fc-n^  Fc  Fn.j 


£e  0 

n  n^ 


If 

n  c-n. 


—  g 
n  yc-n. 


FVc 


(3.13 


After  omitting  some  1  and  -1,  for  example,  replacing  n,  for  n.-l 


or  n.+l ,  we  get 


•ft! 


(Fc-Fn,),Fc<FcFc>',Fc 


-3(4c  -Qkc  +  erje'  6k(c-k) 

C  1  nl 


■i  -\((c3~2kc2  +  4k2c-2k3)e'  +  k(3c-2k)f '  ) 
nc  nl  n] 


-tY(4c2  -  9kc  +  6k2)e'  -  6(c-k)f 1  ) 

n1  V 


(Ulc-k)^  -  (3c-2k)f-  ) 


^(c(4c-3k)e'.ni  -6(c-k)f'.ni) 
^(c(c-k)2e'.ni  +  k(3c-2k)f*_ni) 


-  ^(c<4c-3k)e'_n]  -6(c-k)f^)  0 


-^(c(2c-k)«‘  -<3c-2k)f'  ) 


-te' 

c  n-c 


Set  G  =  F  (F1  F  )_1F'  -  F  (F'  F  J’V 
c  c  c'  c  n1  n^1  n-j 

tion,  we  can  get 


(^1j )nxm*  By  comPlex  calcula 


E,j,91'£l'  -Ej,{tr(FC(FCFc)',Fi)+  )».?  ■ 
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V  *. 


I.-' 


E|,Lgijeiej|2  ’  ^/i  280°’- 

*  /  J 


(3.16) 


Write  Y*  =  e,F'_ni(I-Fc(F‘Fc)“1|:;).  From  (3.14)  and  (3.3),  we  get 


kV 


3kV 


4n  c 


^4-(62-B1)2  Iy'y  l^TT(e2-^)2  +  — °-  ~y~^—  B  2  •  (3.17) 


Hence, 


,.4  3 
3k  n 


Var(y'e)  =  a2tr  yy'  =  o2y'y  <  — el^  +  —  "g  -  Bo-  (3*18) 

n  c  n4 


By  (3.8),  (3.9)  and  (3.5) 


*2  -2 
°nc  "  °nn 


*  -  2Y'e  +  e'Ge  +  y'y- 


(3.19) 


/ a2  a 2  \ 

Now  we  discuss  (<j  -  a~\  ). 

nc  nn-j 


Case  1.  0.  f  eP  and  k  =  c  -  n,  >  — .  We  have 

'  1  log  n 


P(4-“nn,  ^  *  P<-V«*«*G.  >-*£) 


i  P(  |y' £ |  ^y'y/8)  +  P(  Je 1  Ge  |  >_  3^1) 

/ 

Var(Y'e>  +  p(|(trG1|£,£  -^) + 


^Var(Y,E,  +  ^E|^^l+*ES^)' 


By  (3.15)-(3.18), 


P(o‘  -  a  >  JU-)  >  -  +  -^r-o2  +  MilggOo 

nc  nn^  —  2n  —  y  Y  y'y  ^ 


(y'y)‘ 


120a2(e,  -  B?)"2  ?  .  2  4  , 

<  K - - n2c4  +  33600a4(^)(B2- B^"4 

k  k  rii 


2/n2\2 


<  128a^(62  -  0-, ) 


-2/  nl 


300a"(B2-61)'£(^I)\  if  k  >  n, 


300o2(b2-B1)"2(\)2,  if  k  >  0] 
k  k 


<  130o2(b2  -  B1  )”2( log  n)"2  ->  0. 


Case  2.  Bj  t  B2>  k  =  c  -  n-j  <  n/log  n.  It  follows  that  for  any 


u  >  0, 


<  P<l*r*.|  >  TlS?)  *  PCI--S.I  Lrfirf 

<  ^1^1  ,Y  .yo2  *  1121"  ..8c,2  *  2802^  _ 

u  n  t  log  n 


by  (3.15)-(3.18). 


Besides,  note  that  I?_i(ej-o2)  is  a  martingale  and  A  (A1  A  )_1A 

•  '  n^  n-j  n-j 

1  0,  so  by  Marcinkiewicz-Zygmund-Burkholder's  martingale  Inequality, 
we  have,  for  any  t,  6  and  u:  0  <  T  <  <5/(  1+6) ,  u  >  0. 

pn°L-o2|  >  un"T) 


P(  |  e 1  e  -  no2 1  >_ 


)  +  p(e'A  (A*  A  )_1A'  e  > 

\  ni  ni  ni  nl  “  2  ) 


icS,uElEll2tS"‘0+5)(1"T)-"  +  P(tI-(An)(\An)>',*i))c''  it'] 


,  ,2+5  -(6-(1+«)t) 


nT»no2 


From  Case  1  and  Case  2,  the  theorem  is  true  when  8^  j*  8£. 


Case  3.  8-|  =  this  case,  for  any  u  >  0, 

d/ia2  a2  I  u  \ 

^an_  ”  anJ  -  log 


'c  "0 


■  P(l*'(I-Fc(FcFcr'Fc)x  -  *'(I'F0(F6F0)’1fo)xI  -  Tosmi1- 


o  ■  e’Fc-oC1  -  Fc<FiFc>',Fi)-  Go  '  fc<fcfc>",f;  -  Fo  W'V 


Then 


P('V%  I  iTS-n*  iT^T>  *  WI«V)I  -O' 


'c  0 


p^yoeI  iO  rV,  ,tr(YoY) 


<*LJL£>£l !.o,  (n  -  -) 

u  *n6 


when  n  -  c  >  log  n. 


(3.23) 


P{£,ViT^} 


<  pttr(Fc(F;Fc )’}rQ  +  F0(F0F0)"lFo)e,e  - 


<  i°g  n 

-  un 


-  IHog'n  "  °» 


(3.24) 


When  n  -  c  <  log  n,  going  along  with  the  same  line  as  Case  2,  we  can  also 


<  P<  I  E911e|  |  1  $  ^3  n}  +  P{l  .Lgiieieil  - 


By  (3.23)-(3.25) ,  we  have 


a2  “2  P 

a  -  o  — ►  0,  as  n  4  ». 

"c  n0 


Finally,  going  along  with  the  same  line  as  (3.22),  for  any  u  >  0  and 
r  such  that  0  <  t  <  we  have 


p(|%  -  o  I  1  un"T) 
n0 


<  P(U'£-nc2|  >  +  P(e'Fn(F«Fn)",Fne  > 


O'  0  0'  'O'--  2 


nT(l+6)  _t  o 
-  c6 - 6 - +  C5‘T*2°^  ^  °*  (as  n  -*■  »), 


where  c^  is  a  constant  only  dependent  upon  e. 
Thus  we  complete  the  proof. 


(3.26 


/v:'.w;vV; 
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4.  WHEN  ERROR  IS  NON-NORMAL 


When  the  distribution  of  random  error  e(t)  is  nonnormal,  we  can  use 
the  theory  of  strong  approximation  of  partial  sums  of  i.i.d.  variables  by 
Brownian  Motion  Process  to  give  some  extensions  of  Theorem  1  to  nonnormal 
errors. 

THEOREM  4.  Let  e^,e2»  ...  be  i.i.d.  random  errors,  and  their  common 
moment  generating  function  exists  in  a  small  neighborhood  of  zero,  i.e., 

E  exp(te^)  <  «  for  |t|  small  enough,  (4.1) 

then  the  result  of  Theorem  1  remains  valid. 


Proof.  Put 


Sk  =  Snk  '  "a"ne^/o»  k  =  1,2 . "• 

then  there  exists  a  Brownian  motion  process  (W(t),  t  >_  0}  such  that 

lim  sup{sup|S.  -  W(k) | /log  n)  <  »,  a.s.  (4.2) 

n-v®  k<n 


based  on  Komlos-Major-Tusnady  (1975,  1976). 
Since 


0  ~  2/m  "  2S|(-m  +  2Sk-3m’  Sk-4m)  ’ 


we  have  for  4m  ^  k  ^  n, 


k  1 


2rfn 


(w(k)  -  2W(k-m)  +  2W(k-3m)  -  W(k-4m))| 


<  sup  |S.  -  W(k) | .  (4.3) 

4m<k<n 


uc 


By 


(4.2),  and  noticing  that 


^ -n ■  -*■  0  as  n  -*•  »,  we  get 


Tim  (  max 
n-*®  \4m<k<n 


o 


(w(k)  -2W(k-m)  +2W(k-3m)  -W(k-4m))^  *  0,  a.s. 


(4. 


From  Theorem  1 ,  we  get 


lim  P(  sup 
it-*®  /4m<k<n 


2/m 


(W(k)  -  2W(k-m)  +2W(k  -  3m)  -  W(k  -  4m j) 


<  An(x)J 


*  exp{-2e'x}. 


(4.5 


where  An(x)  is  defined  by  (2.5).  Thus,  (2.6)  is  also  true  based  on 
(4.3)-(4.5).  Theorem  4  is  proved. 


Notice  that  under  the  assumption  (4.1),  the  result  of  Theorem  3  is 
also  true.  We  can  apply  the  method  of  the  previous  two  sections  to  the 
case  where  (4.1)  is  valid. 

Re-examining  the  condition  under  which  (4.4)  is  true,  we  find 
that  with  the  help  of  another  result  of  Majors  (1976),  only  is  it 
necessary  that  E | e-j  |  <  *,  where  6  >  0.  As  a  result,  it  Is  stated  as 

follows : 


THEOREM  5.  Let  e^,  ...  be  i.i.d.  random  errors  with  finite 

(2  +  6)-th  moment,  where  5  >  0,  and  m  >>  n^^+<5\  Then  (2.6)  is  also 


true. 


5.  ESTIMATION  OF  THE  SLOPE  CHANGE  -  3£ 

In  order  to  form  a  point  estimation  of  the  slope  change  3-j  -  32, 

the  following  procedure  Is  available: 

1.  Find  c  such  that  |Y  !  =  e  =  max  |Y.  I, 

c  n  4m<k<n  K 


2.  Compute 


,  -s2  =  —*¥—  i (i •£r->xi — r  ?  s  1 

1  2  c(e-l)  1=1  2  1  (n-c)((n-c)-l)  1=c+l  2 


.  n+c+1 


(5.1) 


The  value  of  3-|  -  32  is  taken  as  an  estimator  of  (3^  -  32).  It  is  a  LSE 
of  3^  and  32  when  c  is  the  slope  change  point.  Generally,  if  c  is  too  near 
4m  or  n,  it  would  imply  that  the  slope  change  point  tQ  is  too  near  0  or  1, 
and  the  samples  at  our  disposal  are  perhaps  not  enough  to  give  a  reasonable 
estimate.  For  an  interval  estimation  of  3^  -  32,  we  have  the  following 
asymptotic  theorem  of  3^  -  32* 

THEOREM  6.  Suppose  that  tg  is  the  slope  change  point  and  E|e^|^+5<® 

2  3/4 

for  some  <5  >  and  m  «  n  .  Then,  as  n  +  *, 

/  n  *  /  j  a.  \-3\  / /  ^  -  \  /_  _  L  n  /  a  .  \  /p  .1 


(t03  +  (i’t0)"3)  ”  32))-^  N(0,1),  (5.2) 


where  — ►  means  convergence  in  law. 


Proof.  Without  losing  generality,  we  assume  g  =  1.  Take  c  such  that 


max  | Y . | .  Then,  for  any  0  <  a  <  1  and  a  >  0, 
Ki<n  J 


4m<j<n 


4  \  =!'•' a.”'  of  L if  •o’i'f 


Auf A1*  * wA ijC\ 


Using  Theorem  5  and  slightly  modifying  the  argument  of  Section  2,  we 
easily  prove  that 


lim  P(ntg  <_  c  <_  ntg  +  4m)  =  1. 
n-K» 


(5.4 


Denote  n.|  =  minU:  —  >.  tg,  4m  <_  l  £  n  -  4m}.  Not  loss  of  generality 


assume 


n]  1  c  1  n  “  4m •  Because  ^  can  be  rewritten  as 


6,  -  i2  -  (0,  1,  0,  -))(F^Fc)'1Fjx 


-  (0,  1,  0,  -1)(F'F J-’fKF.  6  +  c) 


c  c'  c'  n. 


by  (3.7)  and  (3.8).  So  it  follows  that 


-  52)  -  (6,-B2)  *  (0,  1,  0.  -l)(F^Fcr1F^(-Fc,n  6  +  c),  (5.6 


where  Fc_n  is  defined  as  (3.13).  It  can  be  calculated  that 


(alc’ki!2c)Va2cfm  a1cek"a2cfk 


<W’f;= 


(na-  -a.  kje'-a.  f'  na„  e'-a.  f! 
2c  4c  '  m  4c  m  2c  k  4c  k 


(5.5 


^lcen-c"^2cgn-c 


-nb0  e'  +b.  g' 
2c  n-c  4c3n- 


0 


0 


« 

% 

agp 

».r 


where  ajc,  bjc,  j  =  1,2,4,  and  em»  fm,  etc.  are  defined  as  (3.8)  and 
(3.11),  and  k  -  c  -  n-j.  According  to  (3.3)  and  (3.13),  after  replacing 
pn  -  qn^  ±1  by  pn  -  qn^,  where  p,  q  are  some  integers,  we  get 


|E{ (p-j-f^)  "  (31-02)}l  = 


i-(o.i.o,-i)(F;Fcr1F;Fc.niai 


6nkn.  kZ(c+2n.) 

=  +  3  ( e2"ei  ^  I 


5kn. 

<  !  ( — 3  •  +  — j~)  (®2“®1  ^  I  —  e2~el  I  * 
c  c  c 


Var{(e1-e2)  -  (e^^)}  = 


(0.1, 0,-l)(F'Fc)"1(F^Fc)'1(0.1» 0,-1)' 


(0,1.0,-1)(F^FC)_1(0,1,0,-1)1 


-  lai^c'^c2-!)'1  +  (n-c)'1(<n-c)2-l)',j. 


Now  we  verify  the  three  criteria  convergenting  to  standard  normal. 
1.  From  the  expressions  (5.1)  and  (5.6),  we  have 


c  y  ,,n  .2+6  r+1  2+6  2+6 

I.(-rrn-)  H-^rl  EN  + 


<  KE|e1 


l  (— - L^L- 5 - )  I1’1 

1=d+r  (n-c)[(n-c)  -1]/ 

,2+6  n2+«(c-3(2+5!+(3+S)  +  (n-cr3(2+5)+(3+5)) 


„2t6(c-3(2+6)/2  +  (n.c)- 


.2+6  n+r+1  2+6 

)  n-^i  ei 


<  2K(max(c,  n-c))'</2  <  2Kc"6/2  «  2Kt0‘5/2n's/2  ■.  0, 


where  K  is  a  constant. 


2.  Since  n 


»  k,  we  qet 


lim 

n-K» 


|E{(ere2)  -  (B-.-02)>| 

—  -  —  . . -  ^  lim 

/var{(£.|-02)  -  ^ 


4k  . 

7"1*2' 


g^-t^nV3 


-1/2 

) 


<_  lim 
rv*» 


At 


(5.11) 


3.  It  is  easy  to  see  that 

12n3(c'1{c2-l)"1  +  (n-c)"1  ((n-c)2-l) _1)  ->  12(t‘3  +  (l-tQ)'3).  (5.12) 


Combining  (5. 1 0) - ( 5. 12) ,  we  prove  this  theorem. 

Notice  that  tQ  =  (c-2m)/n  Is  a  consistent  estimator  of  tQ.  (Of  course 
only  when  g-j  -  a2  f  0,  tg  is  well-defined.)  In  Section  3,  we  have  intro¬ 
duced  a  consistent  estimator  a„  of  o.  Substituting  tn  for  tn  and  o„  for  o 

n  u  u  n 

we  can  further  get  this  result. 


THEOREM  7.  Suppose  that  the  conditions  of  Theorem  6  are  satisfied. 
We  then  have 


[ ^r&>3+ (t- ‘or3)'1 1/2[<Br  h)  ■  <Bi  •  e2>]  n'0*')- 


(5.13) 


as  n  *>  •. 


A 

When  g^  =  02,  tp  has  no  meaning,  but  the  statistic  tg  is  still  well 
defined.  It  is  not  known  whether  or  not  (5.13)  is  true  for  a-j  =  e2,  and 
(5.13)  cannot  be  used  to  make  a  test  for  the  hyperthesis  3^  =  e2*  How¬ 
ever,  (5.13)  can  be  utilized  to  form  a  confidence  interval  of  (a-|  -  a2)  if 
we  know  0.  f  e«  a  priori  or  the  null  hypothesis  (2.13)  is  rejected. 


REFERENCES 


[  1]  CHEN,  X.R.  (1987).  Testing  and  interval  estimation  in  a  change- 
point  model  allowing  at  most  one  change.  Scientia  Sinica,  Ser.  A. 
to  appear. 

[  2]  CSORGO,  M.  and  HORVATH,  L.  (1986).  Nonparametric  methods  for  change 
point  problems.  To  appear  in  Handbook  of  Statistics,  Vol.  7. 

[  3]  FEDER,  P.I.  (1975).  On  asymptotic  distribution  theory  in  segmented 
regression  problems  —  identified  case.  Ann.  Statist.  3,  49-83. 

[  4]  HINKLEY,  D.V.  (1970).  Inference  about  the  change  point  in  a  sequence 
of  random  variables.  Biometrika  57,  1-17. 

[  5]  HINKLEY,  D.V.  (1971).  Inference  in  two-phase  regression.  j.Amer. 
Statist.  Assoc.  66,  736-743. 

[  6]  HUDSON,  D.J.  (1966).  Fitting  segmented  curves  whose  join  points 
have  to  be  estimated.  J.  Amev.  Statist.  Assoc.  61,  1097-1129. 

[  7]  K0ML0S,  J.  MAJOR,  P.  and  TUSNADY,  G.  (1975).  An  approximation  of 

partial  sums  of  independent  R.V.'s  and  the  sample,  DF,I.  Z.  Wahrsche. 
Verw.  Gebiete,  32,  111-131,  II,  (1976)  34,  33-58. 

[  8]  MAJOR,  P.  (1976).  The  approximation  of  partial  sums  of  independent 
r.v.'s.  2.  Wahrsche.  Veru.  Gebiete  35,  213-220. 

[  9]  KRISHNAIAH,  P.R.  and  MIAO,  B.O.  (1986a).  Some  recent  developments 
on  change  points  problems.  To  appear  in  Handbook  of  Statistics , 

Vol.  7. 

[10]  KRISHNAIAH,  P.R.  and  MIAO,  B.Q.  (1986b).  On  estimation  of  the  number 
and  locations  of  changes  in  slopes.  Technical  Report. 

[11]  QUALLS,  C.  and  WATANABE.  H.  (1972).  Asymptotic  properties  of  Gaussian 
processes.  Ann.  Math.  Statist.  43,  580-596. 

[12]  YIN,  Y.Q.  (1986).  Detection  of  the  number,  locations  and  magnitudes 
of  jumps.  Technical  Report. 


mmmm 


